A Methodology to Scale Containerized HPC Infrastructures in the Cloud

نویسندگان

چکیده

This paper introduces a generic method to scale HPC clusters on top of the Kubernetes cloud orchestrator. Users define their targeted infrastructure with usual syntax for recipes, and our approach automatically translates description full-fledged containerized cluster. Moreover, resource extensions or shrinks are handled, allowing dynamic resize cluster without disturbing its running. The orchestrator acts as provisioner. We applied three orthogonal architectural designs Open Source schedulers: SLURM, OAR, OpenPBS. Through series experiments, demonstrates potential regarding scalability issues simultaneous deployment several job schedulers in same physical infrastructure. It should be noticed that plan does not require any modification either containers schedulers. Our proposal is step forward reconciling two ecosystems cloud. also calls new research directions concrete implementations consolidation servers sober placement policies at level. works contribute running environment test technique robustness by adding removing nodes fly.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

from linguistics to literature: a linguistic approach to the study of linguistic deviations in the turkish divan of shahriar

chapter i provides an overview of structural linguistics and touches upon the saussurean dichotomies with the final goal of exploring their relevance to the stylistic studies of literature. to provide evidence for the singificance of the study, chapter ii deals with the controversial issue of linguistics and literature, and presents opposing views which, at the same time, have been central to t...

15 صفحه اول

A Methodology to Prioritize the Construction Projects of New Railway Infrastructures for Privatization in Railway Networks (Case Study: Iran)

This study aims to develop a novel methodology to prioritize the construction of new railway infrastructures for privatization. The private sector can cooperate to solve the capacity problems of railway networks, by the construction of new infrastructure. The purpose of this study is to answer the basic question that whether the capacity problems of the railway networks can be solved simply by ...

متن کامل

Pilot-Abstraction: A Valid Abstraction for Data-Intensive Applications on HPC, Hadoop and Cloud Infrastructures?

HPC environments have traditionally been designed to meet the compute demand of scientific applications and data has only been a second order concern. With science moving toward data-driven discoveries relying more and more on correlations in data to form scientific hypotheses, the limitations of existing HPC approaches become apparent: Architectural paradigms such as the separation of storage ...

متن کامل

On Scale-out Deep Learning Training for Cloud and HPC

Srinivas Sridharan, Karthikeyan Vaidyanathan, Dhiraj Kalamkar, Dipankar Das, Mikhail E. Smorkalov, Mikhail Shiryaev, Dheevatsa Mudigere, Naveen Mellempudi, Sasikanth Avancha, Bharat Kaul, Pradeep Dubey Intel Corporation [srinivas.sridharan,karthikeyan.vaidyanathan,dhiraj.kalamkar,dipankar.das,mikhail.e.smorkalov,mikhail.shiryaev, dheevatsa.mudigere,naveen.mellempudi,sasikanth.avancha,bharat.kau...

متن کامل

a frame semantic approach to the study of translating cultural scripts in salingers franny and zooey

the frame semantic theory is a nascent approach in the area of translation studies which goes beyond the linguistic barriers and helps us to incorporate cognitive and cultural factors to the study of translation. based on rojos analytical model (2002b), which centered in the frames or knowledge structures activated in the text, the present research explores the various translation problems that...

15 صفحه اول

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Lecture Notes in Computer Science

سال: 2022

ISSN: ['1611-3349', '0302-9743']

DOI: https://doi.org/10.1007/978-3-031-12597-3_13